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(5 7) Abstract: 

PROBLEM TO BE SOLVED: To draw a three-dimensional portrait in parallel by 
drawing the portrait consciously of two-dimensional images only. 
SOLUTION: A selecting section 3 selects two-dimensional parts images from a 
parts storing section 1 following an instruction given from a selection instructing 
section 2 t synthesizes parts by arranging the parts to appropriate positions, and 
supplies the synthesized parts to a displaying section 5. In a three-dimensional 
parts storing section 6, three-dimensional data of the portions of a face are stored 
and correlated with the two-dimensional images stored in the parts storing section 
1 by using IDs, At the time of selecting the two-dimensional parts, the selecting 
section 3 selects the three-dimensional data corresponding to the two-dimensional 
parts images by simultaneously obtaining the IDs from the selecting section 3, A 
three-dimension synthesizing section 8 synthesizes the three-dimensional data into 
one portrait and displays the synthesized picture. A visual point change instructing 
section 10 gives the instruction on the synthesized three-dimensional portrait to 
display the oblique view or side view of the face. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3,In the drawings, any words are not translated. 



CUUMS 



[Claim(s)] 

[Claim 1]In a producing portrait device which combines a part of a face as a part and creates a portrait, By matching with a two- 
dimensional part image prepared for each the whole part of said face, storing three dimensional data r and obtaining as information 
classification and each ID of a part which should be chosen from the exterior. Choose said prepared two-dimensional part image, 
arrange a this chosen two-dimensional part image in a suitable position, and compound as a portrait, and, A three-dimensional 
producing portrait method carrying out a composite display as a portrait seen from the viewpoint by referring to viewpoint changed 
information which arranges three dimensional data obtained by choosing three dimensional data corresponding to said two- 
dimensional part image in a suitable position the whole part, and is directed from the outside. 
[Claim 2]A threes-dimensional producing portrait device comprising; 

A part storage parts store a two-dimensional part image prepared corresponding to each of part ID which is divided the whole part 
of a face and shows each classification, and this ID is remembered to be. 

A selecting part which chooses a two-dimensionaf part image from said part storage parts store, and is sent to a synchronizer by 
acquiring classification of a part and information on ID which should be chosen from the exterior 

A synchronizer which arranges a this selected two-dimensional part image in a suitable position, and is compounded as a portrait 
A three-dimensional part storage parts store with which it is matched with each of a two-dimensional part image memorized by said 
two-dimensional part storage parts store by said ID Information, and three dimensional data is remembered to be, A three- 
dimensional selecting part which acquires ID information from said selecting part, and chooses three dimensionai data corresponding 
to said two~djmensionaf part image from said three-dimensional part storage parts store, A three-dimensional synchronizer which 
arranges said obtained three dimensional data in a suitable position the whole part, is compounded as a portrait seen from the 
viewpoint with reference to viewpoint changed information directed from the outside, and is outputted to a three-dimensional 
display part. 

[Claim 3]The three-dimensional producing portrait device according to claim 2 assigning three dimensional data memorized by a 
two-dimensional part image memorized by said part storage parts store and said three-dimensional part storage parts store to the 
same table. 

[Claim 4]A two-dimensional part memorized by said part storage parts store, By considering it as each image which changed and 
fooked at a viewpoint to a part which constitutes a face, and directing information which shows said viewpoint as attribution 
information in addition to each information on classification of said part, and ID supplied from the outside. The three-dimensional 
producing portrait device according to claim 2 obtaining three dimensional data of said request. 

[Claim 5]Add further a modification directions part which directs every classification of each part of a face, and deformation 
information, and said three-dimensional synchronizer. The three-dimensional producing portrait device according to claim 2 
compounding making it change by calculating based on said deformation information for said modification to three dimensional data 
obtained from said three-dimensional part storage parts store, and outputting to said three-dimensional display part. 
[Claim 6]A list of two-dimensional part images memorized by said part storage parts store is displayed, Or a list display part which 
displays a list of three dimensional data memorized by said three-dimensional part storage parts store if needed is added further 
The three-dimensional producing portrait device according to cfaim 2 obtaining a two-dimensional part image or three dimensional 
data of said request via said selection instructing part referring to a two-dimensional part image or three dimensional data displayed 
here. 

[Claim 7]The three-dimensional producing portrait device according to claim 2 choosing directly three dimensional data with ID 
which adds further a three-dimensional selection instructing part which acquires each information on part classification of a face, 
and ID which should be chosen from the exterior, and is supplied to said selecting part, and is different from said two-dimensional 
part image, 

[Claim 8]A three-dimensional-data input part which inputs three dimensional data from the exterior and is generated as a three- 
dimensional part, The three-dimensional producing portrait device according to claim 2 having further a two-dimensional drawing 
generation part which changes into a two-dimensional part image three dimensional data obtained via this three-dimensional-data 
input part by image processing, 

[Claim 9]The three-dimensional producing portrait device according to claim 8 f wherein said three dimensional data inputted is 
generated by generation or a computer graphic by result obtained by measuring by movie camera material. 
[Claim 10]Texture data acquired by connecting with said three-dimensional part storage parts store aforementioned ID, three 
dimensional coordinate data which the account of ** with correspondence fears, and this three dimensional coordinate data the 
whole classification of a part of a face are assigned. By acquiring as an input each information on the attribute of said texture which 
should be chosen, classification, and ID, The three-dimensional producing portrait device according to claim 2 choosing texture data 
from said three-dimensional part storage parts store, pasting said selected texture together to three dimensional coordinate data 
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obtained from said three-dimensionaf selecting part, and outputting to said three-dimensional display part. 

[Claim 1 1]The three-dimensional producing portrait device according to claim 10 at least one texture data memorized by said 

three-dimensional part storage parts store corresponding, and memorizing them to one ID. 



[Translation done.] 
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* NOTICES * 

JPO and IMP IT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely, 

2, **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Inventionjln this invention, a portrait is created only being conscious of a two-dimensional image. 

Therefore, it is related with the three-dimensional producing portrait method and device which can generate three-dimensional 

[0002] 

[Description of the Prior Art] Generally, a GUI (Graphical User Interface) device is used for a producing portrait device, and it 
creates a portrait by choosing as a part the part of faces, such as a hairstyle of human being registered beforehand, an outline, 
eyes, a nose, and a mouth, and combining it. However, since the part of each part is drawn by two dimensions, it cannot obtain the 
face or profile which were seen from across about the person. This seed producing portrait device is indicated by JP,8~44898,A 
{cited reference 1). for example. The cited reference 1 stores beforehand each part drawn by two dimensions, and creates a portrait 
by putting these in order. The device expressing a three-dimensional face is indicated by JP,1 0-74271, A (cited reference 2), for 
example. The cited reference 2 stores three-dimensional standard face data in memory storage beforehand, changes unevenness 
about the three dimensional lattice data of a face with a user's directions, and is expressing the desired three-dimensional portrait. 
[0003] 

[Problem(s) to be Solved by the Invention]However r in the cited reference 1 mentioned above, creating the face which turned to the 
transverse plane was able to obtain neither a slanting face nor a profile about the person, even if possible. Although the focus of 
the face was extracted and the modification part was defined in the cited reference 2, referring to a former picture, in order to 
obtain these focus, there was a fauft of needing the former picture drawn from two or more directions. In order that this invention 
may cancel the above-mentioned fault, it is made and is a thing. 

By generating the three-dimensional face which made the purpose and the three-dimensional geometric model correspond, and 
corresponded only by combining the part of a two-dimensional face. Even when a portrait is created without visualizing only the 
face of one way, it is being able to obtain as a face of a target person when it sees from multiple directions, and providing the 
three-dimensional producing portrait method and a device. 

When you perform modification operation of movement, rotation, etc. about each part which constitutes a two-dimensional portrait, 
also let it be the purpose to provide the three-dimensional producing portrait method and device which can be made to reflect in 
the modification operation with the same said of each three-dimensional data simultaneously. Also let it be the purpose to provide 
the three-dimensional producing portrait method and device which can be chosen individually by dividing and managing three 
dimensional coordinate data and a texture to each three dimensional data mentioned above, 
[0004] 

[Means for Solving the Problemjfn order to solve a technical problem mentioned above a three-dimensional producing portrait 
method according to claim 1, In a producing portrait device which combines a part of a face as a part and creates a portrait, By 
matching with a two-dimensional part image prepared for each the whole part of said face, storing three dimensional data, and 
obtaining as information classification and each ID of a part which should be chosen from the exterior, Choose said prepared two- 
dimensional part image, arrange a this chosen two-dimensional part image in a suitable position, and compound as a portrait, and. 
Three dimensional data obtained by choosing three dimensional data corresponding to said two-dimensional part image is arranged 
in a suitable position the whole part, and a composite display is carried out as a portrait seen from the viewpoint by referring to 
viewpoint changed information directed from the outside. 

[0005]Written this invention is characterized by a producing portrait device comprising the following at claim 2, 

A part storage parts store a two-dimensional part image prepared corresponding to each of part ID which is divided the whole part 

of a face and shows each classification, and this ID is remembered to be. 

A selecting part which chooses a two-dimensional part image from said part storage parts store, and is sent to a synchronizer by 
acquiring classification of a part and information on ID which should be chosen from the exterior. 

A synchronizer which arranges a this selected two-dimensional part image in a suitable position, and is compounded as a portrait. 
A three-dimensional part storage parts store with which it is matched with each of a two-dimensional part image memorized by said 
two-dimensional part storage parts store by said ID information, and three dimensional data is remembered to be, A three- 
dimensional selecting part which acquires ID information from said selecting part, and chooses three dimensional data corresponding 
to said two-dimensional part image from said three-dimensional part storage parts store, A three-dimensional synchronizer which 
arranges said obtained three dimensional data in a suitable position the whole part, is compounded as a portrait seen from the 
viewpoint with reference to viewpoint changed information directed from the outside, and is outputted to a three-dimensional 
display part. 
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[0006]The three-dimensional producing portrait device according to claim 3 assigns three dimensional data memorized by a two- 
dimensional part image memorized by said two-dimensional part storage parts store and said three-dimensional part storage parts 
store to the same table in the three-dimensional portrait device according to claim 2. The three-dimensional producing portrait 
device according to claim 4, In the three-dimensional portrait device according to claim 2, a two-dimensional part image memorized 
by said part storage parts store, A desired image is acquired by considering it as each image which changed and looked at a 
viewpoint to a part which constitutes a face, and directing information which shows said viewpoint as attribution information in 
addition to classification and ID of said part which are supplied from a selection instructing pari. The three-dimensional producing 
portrait device according to claim 5, In the three-dimensional portrait device according to claim 2, add further a modification 
directions part which directs every classification of each part, and deformation information, and said three-dimensional 
synchronizer, By calculating based on said modification directions for said modification to data obtained from said three-dimensional 
part storage parts store, it compounds carrying out movement transformation and outputs to a three-dimensional display part, In 
the three-dimensional portrait device according to claim 2 the three-dimensional producing portrait device according to claim 6, A 
list display part which displays a list display of a two-dimensional part image memorized by said part storage parts store or a list of 
three dimensional data memorized by said three-dimensional part storage parts store if needed is added further, A desired image is 
acquired via said selection instructing part, referring to an image displayed here. The three-dimensional producing portrait device 
according to claim 7, In the three-dimensional portrait device according to claim 2, classification and ID of a selection part are 
inputted from the exterior, a three-dimensional selection instructing part supplied to said selecting part is added further, and three 
dimensional data with different ID from said two-dimensional part image is chosen directly. 

[0007]The three-dimensional producing portrait device according to claim 8 is [ this invention ] characterized by that the three- 
dimensional portrait device according to claim 2 comprises the following. 

A three-dimensional-data input part which inputs three dimensional data from the exterior and is generated as a three-dimensional 
part. 

A two-dimensional drawing generation part which changes into a two-dimensional image three dimensional data obtained via this 
three-dimensional-data input part, and stores it in said part storage parts store by image processing. 

The three-dimensional producing portrait device according to claim 9 is generated by generation or computer graphic in the three- 
dimensional portrait device according to claim 8 by a result obtained by measuring said three dimensional data inputted by movie 
camera material. The three-dimensional producing portrait device according to claim 10, In the three-dimensionaf producing portrait 
device according to claim 2 r to said three-dimensional part storage parts store. Texture data acquired by connecting 
aforementioned ID, three dimensional coordinate data which the account of ** with correspondence fears, and this three 
dimensional coordinate data the whole classification of a part of a face are assigned, Texture data are chosen from said three- 
dimensional part storage parts store by acquiring as an input each information on the attribute of said texture which should be 
chosen, classification, and ID, Said selected texture is pasted together to three dimensional coordinate data obtained from said 
three-dimensional selecting part and it outputs to it to said three-dimensional display part. To one ID, at least one texture data the 
three-dimensional producing portrait device according to claim 1 1 is remembered to be by said three-dimensional part storage parts 
store in the three-dimensional portrait device according to claim 10 correspond, and are memorized. 

[0008]Since three-dimensional **** is generated in parallel by memorizing a **** two-dimensional part image with correspondence, 
and three dimensional data of each other, and creating a portrait by composition mentioned above only being conscious of a two- 
dimensional part image, It can obtain only by creating a portrait based on a two-dimensional part image as which looked at the 
person from other directions. When modification operation of movement, rotation, etc. is performed about each part which 
constitutes a two-dimensional portrait, you can make it simultaneously reflected in modification operation with the same said of 
each three-dimensional data. 
[0009] 

[Embodiment of the invention] Drawing 1 is a block diagram showing one embodiment of this invention. The three-dimensional 
portrait preparation device shown in dnay^ngJJs constituted by the part storage parts store 1, the selection instructing part 2, the 
selecting part 3, the synchronizer 4, the indicator 5, the three-dimensional part storage parts store 6, the three-dimensional 
selecting part 7, the three-dimensional synchronizer 8, the three-dimensional display part 9, and the viewpoint changing instruction 
part 10. The part storage parts store 1 has memorized the image of the part corresponding to ID and ID of the part for every 
classification of the part of a face. As long as the image of these parts is divided for every part of a face, a handwritten illustration, 
comics, or a photograph may be used for it. The selection instructing part 2 inputs the classification and ID of a part to choose as a 
user's operation, and outputs the classification and ID of a part to the selecting part 3. The selecting part 3 acquires the image of 
the part corresponding to the classification and ID of a part which were obtained from the selection instructing part 2 from the part 
storage parts store 1, and sends it to the synchronizer 4. The classification and ID of a part are outputted also to the three- 
dimensional selecting part 7. The synchronizer 4 arranges the image of the part obtained from the selecting part 3 in a suitable 
position for every part, and outputs it to the indicator 5 as one portrait. The indicator 5 displays the portrait obtained from the 
synchronizer 4, The three-dimensional part storage parts store 6 has memorized the three dimensional data of the part 
corresponding to ID and ID of the part for every classification of a face part. At this time, ID with same, mutually corresponding 
thing is given about the image remembered to be three dimensional data by the part storage parts store 1. When these three 
dimensionaf data is based on measurement data, the picture which sketched each of these part may be sufficient as a two- 
dimensional image, and even if image processing generates automatically, it is not cared about, The three-dimensional selecting part 
7 acquires the three dimensional data of the part corresponding to the classification and ID of a part which were obtained from the 
selecting part 3 from the three-dimensional part storage parts store 6, and sends it to the three-dimensional synchronizer 8. The 
three-dimensional synchronizer 8 arranges the three dimensional data of the part obtained from the three-dimensional selecting 
part 7 in a suitable position for every part, and outputs it to the three-dimensional display part 9 as three-dimensional face data of 
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one sheet The viewpoint changing instruction part 10 inputs the viewpoint at the time of referring to three dimensional data as a 
user's operation, and outputs view information to the three-dimensional synchronizer 8. According to directions of the viewpoint 
changing instruction part 10, the three-dimensional synchronizer 8 makes a viewpoint change of rotation, zoom, etc., and displays 
compound three-dimensional face data on the three-dimensional display part 9. 

[0010]Operation of a three-dimensional producing portrait device with the composition mentioned above is explained. First, the 
information about the classification and ID of a part which were given from the selection instructing part 2 is outputted to the 
selecting part 3. Giving easily is possible if ID of the part which can be used beforehand limits at this time. For example, the 
classification, ID, and the image of the part are described in the ledger of the list, and ID may be specified, referring to this. The 
function which displays separately ID and the image of the part memorized by the part storage parts store 1 may be added. The 
selecting part 3 acquires the classification of a part, and the image of the part corresponding to ID out of the part memorized by 
the part storage parts store 1. An image may be stored on the memory which constitutes the selecting part 3, for example. 
Simultaneously, the selecting part 3 outputs the classification and ID of a part also to the three-dimensional selecting part 7. Each 
image is arranged by the synchronizer 4 at the suitable position according to classification. The position arranged may be 
beforehand defined for every parts, such as hair, an outline, eyes, a nose, a mouth, and an ear. Not only a position but size is 
defined, and it may expand and contract and arrange in the size. The picture which various kinds of parts were compounded and 
became one face is sent and displayed on the indicator 5, If not pleasing while a user looks at the portrait displayed on the indicator 
5 at this time, it is possible to create a portrait, pointing to the classification and ID of a part and changing each part from the 
selection instructing part 2, any number of times. At the same time as these two-dimensional portraits are chosen, compounded 
and displayed, the three-dimensional face which can be referred to from every direction is created by the operation explained 
below. The three-dimensional part storage parts store 6 has memorized the three dimensional data of the part corresponding to ID 
and ID of the part for every classification of the part of a face. At this time, three dimensional data has the image and 
correspondence relations which are memorized by the part storage parts store 1, For example, about the "outline", the picture 
which copied the three dimensional shape data of the jaw from the transverse plane serves as an image of the part. It is matched 
also about ID, for example, "the image of the ID3 watch of an outline" supports "the three dimensional shape data of the ID3 watch 
of an outline." When similarly the thing copying that of the formed data of a "nose" is memorized by the part storage parts store 1 
as an image of a "nose" part, "the image of ID No. 5 of a nose" supports "the three dimensional shape data of ID No. 5 of a nose," 
Thus, mutually, the same ID is given and a **** image with correspondence and three dimensional data are identifiable by ID. The 
three-dimensional selecting part 7 acquires the three dimensional data of the part corresponding to the classification and ID of a 
part which were obtained from the selecting part 3 from the three-dimensional part storage parts store 6. ID obtained from the 
selecting part 3 is the same thing as ID obtained from the selection instructing part 2. Therefore, when "the image of the ID3 watch 
of an outline and ID No, 5 of a nose" is chosen from the part storage parts store 1, similarly "the three dimensional data of the ID3 
watch of an outline and ID No. 5 of a nose" is chosen. Three dimensional data selected by the three-dimensional selecting part 7 is 
outputted to the three-dimensional synchronizer 8. The three-dimensional synchronizer 8 arranges the three dimensional data of 
the part obtained from the three-dimensional selecting part 7 in the suitable position according to classification. It may arrange in 
the position beforehand defined at this time, and each data may be arranged so that the three dimensional object model defined 
beforehand may be touched. When the crevice and lap of each data arise at this time, data may be complemented by numerical 
computation or may be averaged. If one face is compounded with three dimensional data, it will be displayed in the three- 
dimensional display part 9. The viewpoint changing instruction part 10 gives the parameter which changes the viewpoint of rotation, 
a tilt, zoom, Pan, etc. to the three-dimensional face compounded by the three-dimensional synchronizer 8. Since a three- 
dimensional face is displayed on the three-dimensional display part 9 according to such viewpoint changing instruction, it becomes 
possible to display three dimensional shape data from various positions and angles, if the embodiment shown in drawing 1 is 
followed, **** which looked at the person from other directions can be obtained only by creating the portrait based on a two- 
dimensional image. This is because three-dimensional face data is generated [ memorizing the image part and three dimensional 
data which were matched mutually, and creating the portrait only being conscious of a two-dimensional image ]. 
[001 1]According to the embodiment shown in drawing 1 , the image data memorized by the part storage parts store 1 and the three 
dimensional data memorized by the three-dimensional part storage parts store 6 are stored in the memory of a different place on 
the same memory, or a different body at each, and is matched by oniy ID. However, when carrying out product mounting concretely, 
as shown in drawing 2 , it is possible to store image data {two-dimensional part) and three dimensional data (three-dimensional part) 
in the same memory table. The same ID is mutually given to a **** image with correspondence, and three dimensional data, and it 
is the same as that of the embodiment shown in drawing 1 that it is identifiable by ID. For example, about the "outline", the picture 
which copied the three dimensional shape data of the jaw from the transverse plane serves as an image of the part. It is matched 
also about ID, for example, "the image of the ID3 watch of an outline" supports "the three dimensional shape data of the ID3 watch 
of an outline," When similarly the thing copying that of the formed data of a "nose" is memorized as an image of a "nose" part, 
"the image of ID No, 5 of a nose" supports "the three dimensional shape data of ID No. 5 of a nose." Each composition of the 
selecting part 3, the three-dimensional selecting part 7 and the synchronizer 4, the three-dimensional synchronizer 8, and the 
indicator 5 and the three-dimensional display part 9 may be summarized in one composition with each function explained by the 
embodiment shown in drawing 1 in this case. 

[0012]In the embodiment shown in drawing J., the image data of each part is explained as that on which the picture seen from one 
way is drawn. For example, on the image of each part seen from the front direction of a face, and the concrete target, the 
transverse-plane image of hair, the transverse-plane image of an outline, the transverse-plane image of eyes, the transverse-plane 
image of a nose, the transverse-plane image of the mouth, etc. were memorized by the part storage parts store 1, chose and 
compounded these, and were creating the portrait on them. The image which is acquired by being created by this appearance and 
which is displayed on the indicator 5 is exactly the portrait which looked at the face from the transverse plane. Here, as an image 
memorized by the part storage parts store 1, as shown in drawing 3, images seen from for all directions, such as an image seen not 
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only from a transverse plane but from 15 slant, an image seen from 30 slant, a profile image, shall be memorized as a part, 
respectively. In addition to the classification and ID of a part which were explained in the first example, at this time, the attribution 
information of parts, such as "15 slant" and "30 slant", is also directed in the selection instructing part 2. At this time, the 
selecting part 3 will have a function which chooses the part memorized by the part storage parts store 1 based on the 
classification, ID, and attribution information of a part. Thereby, three-dimensional face data is also simultaneously obtained by 
creating a two-dimensional portrait, for example, visualizing the face of 15 slant For example, if the outline of 15 slant, hair, eyes, a 
mouth, and a nose are chosen, the portrait of 15 slant will be created by the indicator 5. At this time, like the embodiment shown in 
drawin g 1, the three dimensional data corresponding to these images is chosen from the three-dimensional part storage parts store 
6, is compounded, and is displayed on the three-dimensional display part 9 as a three-dimensional face. It becomes possible by 
directing so that it may turn to a transverse plane from the viewpoint changing instruction part 10 to obtain a front face. Since 
similarly a three-dimensional face is compounded, visualizing the face of 30 slant when a two-dimensional portrait is created, it is 
possible to obtain a transverse plane and the face of 15 slant. Since the part seen from two or more angles is associated, 
respectively, the image which looked at a certain part from the transverse plane, and a certain portion can choose here the image 
seen from 30 slant. For example, since the three dimensional data corresponding to each is chosen even when a transverse plane, 
and an outline and an ear choose the part seen from across, hair and eyes can compound three-dimensional face data. If a front 
portrait is created using the part seen from two or more angles being associated, respectively, it is possible to obtain the portrait of 
15 slant and the portrait of 30 slant. For the purpose, the function which chooses the part of the attribute which carried out 
selection instructing by the selecting part 3, and a different attribute is added. For example, suppose that the part with a front 
attribute was chosen and the portrait was created. If the selecting part 3 chooses the part in which ID is the same as classification, 
and has the attribute of 15 slant at this time, the portrait of 15 slant will be compounded by the synchronizer 4, and will be 
displayed on the indicator 5. 

[0013] Drawin g 4 is a block diagram showing other embodiments of this invention. Here, in addition to the composition which the 
embodiment shown in drawing 1 has, the modification directions part 1 1 is added as an element, and that information is outputted to 
the three-dimensional synchronizer 8 from the synchronizer 4 only differs from the embodiment shown in drawing 1. The place 
where the image of the part of the face memorized by the part storage parts store 1 is chosen by the selecting part 3 at, and is 
compounded by the synchronizer 4 by directions of the selection instructing part 2 is the same as that of the embodiment shown in 
drawing 1 , For every classification of each part, the modification directions part 11 inputs deformation information, such as 
movement, rotation, scaling, reversal, as a user's operation, and outputs directions information to the synchronizer 4. The 
synchronizer 4 is compounded based on directions information, carrying out movement transformation of the part of each part. The 
modification which shows "" outline, "" eye, and the features of a face, such as ", by this to eye for "mouth thinly greatly is 
possible. These modification is possible by being expressed by the operation to a two-dimensional image. At this time, the 
synchronizer 4 outputs these directions information to the three-dimensional synchronizer 8 simultaneously. The place which three 
dimensional data with corresponding ID is chosen by the three-dimensional selecting part 7, and is compounded by the three- 
dimensional synchronizer 8 about three dimensional data is the same as that of the first example. Based on the directions 
information acquired from the synchronizer 4, "is performed for "mouth and the three-dimensional synchronizer 8 performs for 
"outline "and modification which shows the feature of faces, such as ", to eye for "eye thinly greatly. These modification 
operations are possible by being expressed by the operation to three dimensional data. The synthetic face of the three dimensional 
data which changed here is displayed in the three-dimensional display part 9. Thereby, the three-dimensional face data which can 
be referred to from other directions is generable in a creation way by modification operation of a two-dimensional portrait 
[Q014] Drawing 5 is a block diagram showing the example of further others of this invention. Here, in addition to each composition of 
the embodiment shown in draw ing 1, the list display part 12 is added as an element, and the difference with the embodiment shown 
" n drawing j ^differs only in information being outputted to the list display part 12 from the part storage parts store 1 and the three- 
dimensional part storage parts store 6. The fist display part 12 displays the image of the part memorized by the part storage parts 
store 1 on a list. At this time, a fist of the part of the classification directed in the selection instructing part 2 may be displayed, and 
ID of a part may be displayed collectively. The user can decide ID of the part it is considered that is suitable, referring to the image 
of the part displayed on the list display part 12. The three dimensional data of the part memorized by the three-dimensional part 
storage parts store 6 is abo displayed on a list. It may match with a two-dimensional image, and may arrange and display. The user 
can judge also referring to the displayed three dimensional data for the part which cannot opt for selection only by reference of an 
image collectively. The list display part 12 and the selection instructing part 2 are made to cooperate, and it may be made to be 
chosen as long as it clicks the image displayed on the list display part 12. 

[001 5] Drawing 6 is a block diagram showing the embodiment of further others of this invention. It only differs that the difference 
with the embodiment shown in d rawing 1 has the three-dimensional selection instructing part 13 as an element in addition to the 
composition of the embodiment shown in drawing 1 . The three-dimensional selection instructing part 13 inputs the classification and 
ID of a selection part as a users operation, and has a function outputted to the three-dimensional selecting part 7. At this time, the 
three-dimensional selecting part 7 chooses a part from the three-dimensional part storage parts store 6 based on the classification 
and ID of a part which were given from the three-dimensional selection instructing part 13. According to the embodiment shown in 
drawing 1 , the three-dimensional part matched with the two-dimensional part given from the selecting part 3 by the three- 
dimensional selecting part 7 was chosen. However, when a three-dimensional face h obtained and a different face from the 
impression which it was going to illustrate is displayed, the demand which wants to correct a three-dimensional face occurs, What is 
necessary is just to direct the classification and ID of a three-dimensional part to choose directly from the three-dimensional 
selection instructing part 13, when such. It enables this to choose the three-dimensional part of different ID -from a two-dimensional 
part. 

[001 6]D rawing J j s a block diagram showing the embodiment of further others of this mvention, It only differs that the difference 
with the embodiment shown in drawing 1 has the texture selection instructing part 14 and the texture selecting part 15 as an 
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element in addition to the composition of the embodiment shown in drawing. In each embodiment mentioned above, three 
dimensional data performed explanation which doubles the texture which shows three-dimensional coordinate data and color, and 
concentration, for example. When choosing the three dimensional data for various every exception, the three-dimensional face 
assumed that it was what is compounded and displayed. However, actual three dimensional data may be considered to be a texture 
mapped by the rugged surface acquired by connecting three-dimensional coordinate data and coordinate data. Here, the three- 
dimensional part storage parts store 6 remembers texture data to be the three-dimensional part matched with ID for every 
classification of the part of a face. Two or more texture data may correspond to one ID, as shown, for example in drawing 8. For 
example, the difference in a makeup is memorizable as a texture. The texture selection instructing part 14 inputs the attribute, the 
classification, and ID of a texture to choose as a users operation, and outputs them to the texture selecting part 15. The attribute 
of a texture expresses here distinction of two or more textures matched with 1 1D. Based on the attribute, the classification, and ID 
of a texture, the texture selecting part 15 chooses texture data from the three-dimensional part storage parts store 6, and outputs 
them to the three-dimensional synchronizer 8. The three-dimensional synchronizer 8 pastes together the texture obtained from the 
texture selecting part 15 to the three dimensional data obtained from the three-dimensional selecting part 7, and outputs it to it at 
the three-dimensional display part 9. Since a different texture can be stuck to one three dimensional data by this, it becomes 
possible to express the difference in the face by makeup. If it has agreed to the target impression which expression tends to 
illustrate, three dimensional data and the texture do not necessarily need to correspond. 

tQQ17]Dra wJ ,ng„9_is a block diagram showing the embodiment of further others of this invention. In addition to the composition of the 
embodiment shown in drawing 1, having the three-dimensional-data input part 17 and the two-dimensional drawing generation part 
16 as an element only differ. The three-dimensional-data input part 17 and the two-dimensional drawing generation part 16 have a 
function which generates the part memorized by the part storage parts store 1 and the three-dimensional part storage parts store 
6. The three-dimensional-data input part 17 inputs the three dimensional data of the face measured with the stereo camera or the 
range finder, the three dimensional data of the face generated by CG, etc., generates the three-dimensional-coordinates sequence 
and solid model showing the surface of a face as a three-dimensional part, and stores them in the three-dimensional part storage 
parts store 6, The two-dimensional drawing generation part 16 changes into a two-dimensional image the three dimensional data 
obtained from the three-dimensionahdata input part 17 by image processing, such as converted density and outline extraction, and 
stores it in the part storage parts store 1. If image processing is performed about the direction from which three dimensional data 
differs at this time, ft is possible to generate the two-dimensional image of different direction and to store these. Thereby, three- 
dimensional data and the part of a two-dimensional image can be automatically created from three-dimensional measurement data. 
[0018]Like explanation above by matching this invention with the two-dimensional part image prepared for each the whole part of a 
face, storing three dimensional data, and obtaining the classification and each ID of the part which should be chosen from the 
exterior, Choose the prepared two-dimensional part, arrange the this chosen part in a suitable position, and compound as a portrait 
and. Arrange the three-dimensional part obtained by choosing the three-dimensional part corresponding to a two-dimensional part 
in a suitable position the whole part, carry out a composite display as a portrait seen from that viewpoint with reference to the 
viewpoint changed information directed from the outside, and by this. Only by creating the portrait based on a two-dimensionai part 
image, **** which looked at the person from other directions can be obtained. 
[0019] 

[Effect of the Invention]Since three-dimensional **** is generated in parallel like explanation above by memorizing a **** image 
part with correspondence, and three dimensional data of each other, and creating a portrait only being conscious of a two- 
dimensionaf image according to this invention, **** which looked at the person from other directions can be obtained onfy by 
creating the portrait based on a two-dimensional image, and also the effect of enumerating below is acquired. 

(1) When a two-dimensional portrait is created by storing correspondence price ************** in a two-dimensional image part, a 
three-dimensional face can be obtained simultaneously. 

(2) Change and refer to the viewpoint for the three-dimensional face obtained above (1) arbitrarily. 

(3) Even if it chooses the part of a direction which is different for every part of a face by matching and storing the two-dimensionaJ 
part image seen from several different directions, a three-dimensional face can be obtained simultaneously. 

(4) About each part in a two-dimensional portrait, when modification operation of movement, rotation, etc. is performed, the 
modification operation with the same said of each three-dimensional data is reflected simultaneously. 

(5) The part to mean can be chosen, comparing both by putting in order and carrying out the fist display of a two-dimensional image 
and the three-dimensional data. 

(6) With regards to both correspondence, it can also choose about a two-dimensional image and three-dimensional data that there 
is nothing, 

(7) Three dimensional coordinate data and a texture can be divided and managed about three dimensional data, and it can choose 
individually. 

{8} Two-dimensional drawing can be generated from three dimensional data, and the part of a two-dimensional image and three 
dimensional data can be registered automatically. 
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* NOTICES * 

JPO and INP1T are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Qrawjngjjlt is a bfock diagram showing one embodiment of this invention. 

[Drawing 2] It is a figure showing an example of the data structure of the part memorized by the part storage parts store and three- 
dimensional part storage parts store in drawing 1 . 

tPl.?w?.0S„3.1It is a figure showing other examples of the data structure of the part memorized by the part storage parts store and 
three-dimensional part storage parts store in drawing 1. 

[p£#wi.0jg„4]Jl: is a block diagram showing other embodiments of this invention. 
[Drawing 5] It is a block diagram showing the embodiment of further others of this invention. 
[Drawing 6] It is a block diagram showing the embodiment of further others of this invention, 
LQL*^wmg„7jIt is a block diagram showing the embodiment of further others of this invention. 

[Drawing 8] It is a figure showing an example of the data structure of the part memorized by the three-dimensional part storage 
parts store in drawin g 1 , 

[Q^winS 9]lt is a block diagram showing the embodiment of further others of this invention. 
[Description of Notations] 

1 [ — A synchronizer, 5 / — Indicator, 3 — A part storage parts store, 2 — A selection instructing part, 3 — A selecting part, 4 6 
[ — Three-dimensional display part, ] — A three-dimensional part storage parts store, 7 — A three-dimensional selecting part, 8 - 
- A three-dimensional synchronizer, 9 10 [ — A three-dimensional selection instructing part, 14 / — A texture selection 
instructing part, 15 / — A texture selecting part, 16 / — A two-dimensional drawing generation part, 17 / — Three-dimensional- 
data input part ] — A viewpoint changing instruction part, 11 — A modification directions part, 12 — A list display part, 13 
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iLfUcfcU, "n&A#<" "g 

TcStttt 7 iCT^JR £ *K = ftSE-fifiM* 8 let £j£ $ tl 
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>f<t5 0 d©£#, WR«*S2-e«^$ixfcW8iJ«>^ 



(6) #120 0 0-2 9 3 7 1 0 

10 

flMrT#J» L«e*« t>, flBrf 5 - i 5i? t4 
10 5. $ 1 2 t atRjg^A 2 SragDS** 

t0 0 1 5] H6»±**R©5!tttO**®1IS*:*i-^ 
oy^Hl?*>5. 01ic?T^-^jj£^iit^^ii s Jill 
lc*i-|dfi»IBo«jatldini, Eft5ca«*B**|S 1 3^ 

HatiLT^oiio^iwes. HjstjaiiRft^ts 1 3 

r©t^=ft5tjlKg|5 7fi, =»:5c3iR}fi*ffl!l 3A»E> 
-efi, HftS®^ 7 {CT, iira 3 X v) fyx hixtc~ 
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